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Abstract — The problem of computing sum of sources over a 
multiple access channel (MAC) is considered. Building on the 
technique of linear computation coding (LCC) proposed by Nazer 
and Gastpar 1 1 1, we employ the ensemble of nested coset codes 
to derive a new set of sufficient conditions for computing sum 
of sources over an arbitrary MAC. The optimality of nested 
coset codes |2| enables this technique outperform LCC even for 
linear MAC with a structural match. Examples of non-additive 
MAC for which the technique proposed herein outperforms 
separation and systematic based computation are also presented. 
Finally, this technique is enhanced by incorporating separation 
based strategy, leading to a new set of sufficient conditions for 
computing sum over a MAC. 

I. Introduction 

Consider a scenario wherein a centralized receiver is in- 
terested in evaluating a multi-variate function, the arguments 
of which are available to spatially distributed transmitters. 
This scenario models many practical and fundamental multi- 
terminal communication problems. For example, consider a 
distributed sensor network assigned task of detecting intrusion. 
A fusion center is interested in computing posterior probability 
of intrusion based on observations made by spatially dis- 
tributed nodes. In this problem, the centralized receiver desires 
to compute relevant function of the sufficient statistic needed 
to compute the posterior probability. In a more theoretical 
setting, the best known strategy for the problem of distributed 
source coding, that is optimal for particular instances, relies 
on computing a function of the source quantizations. 

Traditionally, the technique of computing functions at a 
centralized receiver is based on it's decoding of the arguments 
in it's entirety. Solutions based on this technique have been 
proven optimal for particular instances of distributed source 
coding. Moreover, this technique lends itself naturally for 
communication based on separation. Buoyed by this partial 
success and ease of implementation, the de facto framework 
for computing at a centralized receiver is by enabling the 
decoder decode the arguments of the function in it's entirety. 

The problem of computing mod-2 sum of distributed binary 
sources has proved to be an exception. Studied in the context 
of a source coding problem, Korner and Marton [3 | propose 
an ingenious technique based on linear codes, that circumvent 
the need to communicate sources to the decoder, and thereby 
perform strictly better for a class of source distributions. In 
fact, as proposed in J3], the decoder needs only sum of 



message indices put out by the source encoder. This fact has 
been further exploited by Nazer and Gastpar [1 1 in developing 
a channel coding technique for a linear MAC, henceforth 
referred to as linear computation coding (LCC), that enables 
the decoder reconstruct the sum of the message indices input 
to the channel encoder. Since the decoder does not need to 
disambiguate individual message indices, this technique, when 
applicable, outperforms earlier known techniques. 

LCC HI is built around employing the same linear code 
as a channel code at both encoders. The message indices 
output by the Korner-Marton (KM) source code is linearly 
mapped into channel codewords. Since a linear MAC first 
computes a sum of the transmitted codewords, it is as if the 
codeword corresponding to the sum of messages was input to 
the ensuing channel. The first question that comes to mind is 
the following. If the MAC is not linear, would it be possible 
to decode sum of message indices without having to decode 
the individual codewords? In other words, what would be the 
generalization of LCC for an arbitrary MAC?3 If there exist 
such a generalization, how efficient would it be? 

In this article, we answer the above question in the af- 
firmative. Firstly, we recognize that in order to decode the 
sum of transmitted codewords, it is most efficient to employ 
channel codes that are closed under addition, of which a 
linear code employed in LCC is the simplest example. Closure 
under addition contains the range of the sum of transmitted 
codewords and thereby support a larger range for individual 
messages. Secondly, typical set decoding circumvents need 
for the MAC to be linear. Since nested coset codes have 
been proven to achieve capacity of arbitrary point to point 
channel and are closed under addition, we employ this 
ensemble for generalizing the technique of LCC. As illustrated 
by examples II 121 in section [TTT1 the generalization we propose 
(i) outperforms separation based technique for an arbitrary 
MAC and moreover (ii) outperforms LCC even for examples 
with a structural match|3 We remark that analysis of typical set 
decoding of a function of transmitted codewords with nested 
coset codes that contain statistically dependent codewords 

The technique of systematic computation coding (SCC) [1| may not be 
considered as a generalization of LCC. Indeed SCC does not reduce to LCC 
for a linear MAC. 

2 This is expected since linear codes achieve only symmetric capacity and 
nested coset codes can achieve capacity of arbitrary point to point channels. 



contains new elements. The reader is encouraged to peruse 
details of these elements in (4). 

Even in the case of a structural match, separation based 
schemes could outperform LCC 0] Example 4]. This raises the 
following question. What then would be a unified scheme for 
computing over an arbitrary MAC? Is there such a scheme that 
reduces to (i) separation when the desired function and MAC 
are not matched and (ii) LCC when appropriately matched? 
We recognize that KM technique is indeed suboptimal for 
a class of source distributions. For such sources, it is more 
efficient to transmit the sources as is. We therefore take the 
approach of Ahlswede and Han [5] Section VI], where in a 
two layer source code accomplishes distributed compression. 
The first layer generates message indices of those parts that 
are best reconstructed as is, and the second part employs a KM 
technique. In section HVl we propose a two layer channel code 
for MAC that is compatible with the above two layer source 
code. The first layer of the MAC channel code communicates 
the message indices as is, while the second layer enables the 
decoder decode the sum of second layer message indices. We 
therefore develop a unifying strategy that subsumes separation 
and LCC. Since Ahlswede and Han (5, Example 4] have 
proved the existence of source pairs for which their scheme 
outperforms both separation based and KM strategy their 
findings carry over to the problem studied herein. 

We highlight the significance of our contribution. Firstly, 
we propose an alternative strategy for the particular problem 
of computing sum of sources over an arbitrary MAC and 
derive a new set of sufficient conditions for computing over 
an arbitrary MAC that subsumes LCC, SCC and separation 
based strategies. For the particular problem of computing 
linear functions over linear MAC our strategy reduces to that 
proposed by Nazer and Gastpar [Q, yet is more efficient than 
the latter. Secondly, our findings highlight the utility of nested 
coset codes Q as a generic ensemble of structured codes for 
communicating over arbitrary multi-terminal communication 
problems. Thirdly, and perhaps more importantly, our findings 
hint at a general theory of structured codes. Linear and nested 
linear codes have been employed to derive communication 
strategies for particular additive source and channel coding 
problems that outperform all classical/unstructured known 
techniques. However the question remains whether these struc- 
tured code based techniques can be generalized to arbitrary 
multi-terminal communication problems. Our findings indicate 
that strategies based on structured codes can be employed to 
analyze more intelligent encoding and decoding techniques for 
an arbitrary multi-terminal communication problem. 

This article is organized as follows. We begin with prelim- 
inaries and a brief description of LCC in section Section 
Hn] contains the main findings of this article - a generalization 
of LCC for an arbitrary MAC using the ensemble of nested 
coset codes. Theorem [TJ is a statement of this characterization 
and examples [TJ2] highlight the significance of theorem [TJ In 
section IIVI we propose a unified strategy for computing sum 
of sources over an arbitrary MAC that subsumes separation 
and LCC based techniques. 



II. Preliminaries and Problem statement 

Following remarks on notation (III-Ab and problem statement 
(IlLBl) . we briefly describe LCC for a linear MAC fflLCt and 
set the stage for it's generalization. 

A. Notation 

We employ notation that is now widely adopted in the 
information theory literature supplemented by the following. 
We let T q denote a finite field of cardinality q. While + 
denotes addition in K, we let ffi denote addition in a finite field. 
In this article, we repeatedly refer to pairs of objects of similar 
type. To reduce clutter in notation, we use an underline to refer 
to aggregates of similar type. For example, (i) S_ abbreviates 
(Si, S 2 ), (ii) if Xi, X-2 are finite alphabet sets, we let X_ either 
denote the Cartesian product Xi x X 2 or abbreviate the pair 
Xi, X 2 of sets. More non trivially, if e, : S n -> Xf : j = 1, 2 
are a pair of maps, we let e(s n ) abbreviate (ei(s™), 62(52))- 

B. Problem statement 

Consider a pair (£1, S 2 ) of information sources each taking 
values over a finite field S of cardinality q. We assume out- 
come (Si t t, 5*2,*) of the sources at time t £ N, is independent 
and identically distributed across time, with distribution Ws_. 
We let (S, Ws) denote this pair of sources. Sj is observed 
by encoder j that has access to input j of a two user discrete 
memoryless multiple access channel (MAC) that is used with- 
out feedback. Let X\, X 2 be the finite input alphabet sets and y 
the finite output alphabet set of MAC. Let Wy\XiX 2 x %) 
denote MAC transition probabilities. We refer to this as MAC 
(X_, y, Wy\x)- The objective of the decoder is to compute 
Si ffi S 2 . In this article, we provide a characterization of a 
sufficient condition for computing Si ffi S 2 with arbitrary small 
probability of error. The relevant notions are made precise in 
the following definitions. 

Definition 1: A computation code (n,e,d) for computing 
sum of sources (S, Ws) over the MAC (X_, y, Wy\x) consists 
of (i) two encoder maps ej : S n — > X™ : j = 1 , 2 and (ii) a 
decoder map d : y n — > S n . 

Definition 2: The average error probability £ (e, d) of a 
computation code (n, e, d) is 

E E Wy n ^(y n \e(s n ))Ws-(s n )- 

Definition 3: The sum of sources (S, Ws) is computable 
over MAC (X_, y, W Y \x) if f° r all V > 0, there exists an 
N(rf) 6 N such that for all n > N(r/), there exists an 
(n, e^ n ' , cr™)) computation code such that ^(ey 1 ' , d^ n ') < rj. 

The main objective in this article is to provide a sufficient 
condition for computability of sum of sources over a MAC. 

C. Linear Computation Coding 

We describe the technique of LCC in a simple setting and 
highlight the key aspects. Consider binary sources and a binary 
additive MAC, i.e., S = X x = X 2 = {0, 1} and Y = X t © 
X 2 © N, where N is independent of the inputs and P(N = 



1) = q. Furthermore assume sources are symmetric, uniform, 
i.e., P{S = (0,0)) = = P{S = (1,1)) and P(S = 
(0,1)) = P(S = (1,0)) = | such that & t (p) < l-h b (q). 

By employing a KM source code, the two message indices at 
rate hbip) can be employed to decode S\ ©5*2. Let h £ S kxn 
denote a parity check matrix for the KM source code, with 
— arbitrarily close to hb(p). Nazer and Gastpar observe that 
the decoder only requires the sum h(Si © S 2 ) = h^S") © 
h{S 2 ) °f message indices. If the map from message indices 
to channel code is linear, then the decoder can infer h(S 1 ) © 
h(S 2 ) by decoding the codeword corresponding to sum of 
transmitted codewords. Since sum of transmitted codewords 
passes through a BSC(<7), they employ a capacity achieving 
linear code of rate arbitrarily close to 1 — hb(q) with generator 
matrix g G #f xn . Each encoder employs the same linear code 
and transmits : = h(S™)g. The decoder receives Y n and 
decodes as if the channel is a BSC(g). It ends up decoding 
message corresponding to which was precisely what 

it was looking for. 

We note that a separation based scheme will require the sum 
capacity of the MAC to be greater than 2hb(p) and hence LCC 
is more efficient. What are key aspects of LCC? Note that (i) 
the channel code is designed for the X\ © X2 to Y channel, 
i.e., the BSC(q) and (ii) both encoders employ the same 
linear channel code, thereby ensuring their codes are closed 
under addition. This contains range of the sum of transmitted 
codewords to a rate 1 — hb(q). It is instructive to analyze the 
case when the two users are provided two linear codes of rates 
Ri and R2 spanning disjoint subspaces. Since the range of sum 
of transmitted codewords is R\ + R2, the same decoding rule 
will impose the constraint R1 + R2 < l — hb(q) resulting in the 
constraint 2hb(p) < l — h b (q) which is strictly suboptimal. We 
conclude that the two users ' channel codes being closed under 
addition is crucial to the optimality of LCC for this problem. 
Furthermore, the coupling of (i) a linear map of KM message 
indices to the channel code at the encoder and (ii) decoding 
of the sum of transmitted codewords, is central to LCC. 

In the following section, we make use of the above observa- 
tions to propose a generalization of LCC for computing sum 
of sources over an arbitrary MAC. 

III. Nested coset codes for computing sum of 

SOURCES OVER A MAC 

In this section, we propose a technique for computing 
Si © S 2 over an arbitrary MAC using the ensemble of nested 
coset codes [2|, and derive a set of sufficient conditions under 
which, sum of sources (S, Ws) can be computed over a MAC 
(X , ."V, Wv\ y). Definitions 3] and theorem Q] state these suffi- 
cient conditions. For certain examples such as example [2] the 
technique proposed in theorem[T]outperforms all known earlier 
techniques. Indeed, as illustrated by examples Q] [2] even in the 
case of a structural match, the above sufficient conditions are 
weaker than that imposed by LCC. Nevertheless, we further 
relax the same in section |IV] or in other words enrich our 
technique, by incorporating separation. 



Definition 4: Let D(W / y|x) be collection of distributions 
Pv 1 v 2 x 1 x 2 y defined over S 2 x X_ x y such that (i) 

Pv 1 x 1 v 2 x 2 = Pv 1 x 1 Pv 2 x 2 , 00 Py\xv_ = Py\x 
Pvxy £ ©(WVix)* l et a (pvxY) be defined as 



W Y \x- F° r 



{R > : R < min{H{Vi),H{V 2 )} - H(Vi © V 2 \Y)} , and 
a(W Y \x) ■ = sup Li pvXY &}(w Y \ X )<x(Pyxy)- 

Theorem 1: The sum of sources (S, Ws)is computable over 
a MAC (X, y, W Y \x) if H{S X © S 2 ) <a(W Y \x)- 
In the interest of brevity, we briefly discuss the coding strategy 
and indicate how we attain the rates promised above. The 
reader is referred to [0] for a complete proof of theorem [T] 

We begin with a description of the encoding rule. Encoder j 
employs a KM source code to compress the observed source. 
Let Ma : = hS™ denote corresponding message index, where 
h € S lxn is a KM parity check matrix of rate ~ « H(S\ © 
82)- Each encoder is provided with a common nested linear 
code taking values over S. The nested linear code is described 
through a pair of generator matrices gj G S kxn and go/i £ 
9i 



S , where gj and 



9o/i 



are the generator matrices of the 



inner (sparser) code and complete (finer) codes respectively, 
where 



j picks 



I W 
- < 1 
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coset 



(a k gi © Mjg /i ■ a k G S k ) indexed by Mj that is typical 
with respect to pv ■ Based on this chosen codeword X n is 
generated according to PXj\Vj an d transmitted. 

The decoder is provided with the same nested linear 
code. Having received Y n it lists all codewords that are 
jointly typical with Y n with respect to distribution Pvi®v 2 ,Y- 
If it finds all such codewords in a unique coset, say 
{a k gi © rn l go/i : a k G S k ), then it declares m l to be the sum 
of KM message indices and employs KM decoder to decode 
the sum of sources. Otherwise, it declares an error. 

As is typical in information theory, we derive an upper 
bound on probability of error by averaging the error prob- 
ability over the ensemble of nested linear codes. For the 
purpose of proof, we consider user codebooks to be cosets 
of nested linear codes0 We average uniformly over the entire 
ensemble of nested coset codes. Lower bound (QI a )) ensures 
the encoders find a typical codeword in the particular coset. 
Upper bound (|TJb)) enables us derive an upper bound on the 
probability of decoding error. From dfl, it can be verified that if 
H(Sx®S 2 ) mm{H(V 1 ),H(V 2 )}-H(V l ®V 2 \Y) then 

the decoder can reconstruct the sum of sources with arbitrarily 
small probability of error. 

Since the ensemble of codebooks contain statistically de- 
pendent codewords and moreover user codebooks are closely 
related, deriving an upper bound on the probability of error 
involves new elements. The informed reader will recognize 
that in particular, deriving an upper bound on the probability 

3 This is analogous to the use of cosets of a linear code to prove achievability 
of symmetric capacity over point to point channels. 



of decoding error will involve proving statistical independence 
of the pair of cosets indexed by KM indices (M^M^) and 
any codeword in a coset corresponding to m ^ M\ © M\. 
The statistical dependence of the codebooks results in new 
elements to the proof. The reader is encouraged to peruse 
details in ||4] Proof of Thml]. 

It can be verified that theorem [T] subsumes LCC. In partic- 
ular the rate region presented in theorem [T] subsumes the rate 
region presented in [1. Theoreml, Corollary 2]. This follows 
by substituting a uniform distribution for Vi,V 2 . Therefore 
examples presented in fl] carry over as examples of rates 
achievable using nested coset codes. 

We now present a sample of examples to illustrate signifi- 
cance of theorem Q] The reader is referred to El for additional 
examples that illustrate utility of the coding technique pro- 
posed herein. As was noted in fl] Example 4] a uniform dis- 
tribution induced by a linear code maybe suboptimal even for 
computing functions over a MAC with a structural match. The 
following example, closely related to the former, demonstrates 
the ability of nested coset codes to achieve a nonuniform 
distribution and thus exploit the structural match better. 

Example 1: Let S\ and S 2 be a pair of independent and 
uniformly distributed sources taking values over the field 
.F5 of five elements. The decoder wishes to reconstruct 
S\ ©5 S 2 . The two user MAC channel input alphabets X\ = 
X2 = J-5 and output alphabet y = {0,2,4}. The output 
Y is obtained by passing W — X\ ©5 X2 through an 
asymmetric channel whose transition probabilities are given 

t>y py|vk(z/|i) = py\w(v\o) = I for each v e y and 

Pr|w(0|0) =^^1^(212) = p Y \w(^H) = 1- Let the number of 
source digits output per channel use be A. We wish to compute 
the range of values of A for which the decoder can reconstruct 
the sum of sources. This is termed as computation rate in JT]. 

It can be verified that the decoder can reconstruct Si ©5 S 2 
using the technique of LCC if A < f^f^ = 0.4096. A 
separation based scheme enables the decoder reconstruct the 
sum if A < h !° S2 lc| = 0.3413. We now explore the use of 

— 2 1og 2 (5) r 

nested coset codes. It maybe verified that pmf 

{1 if v 1 =x 1 ,v 2 =x 2 
4 and vi,v,z{0,2] (2) 
otherwise . 

defined on x T5 satisfies (i),(ii) of definition |4] and moreover 
ajp yx y) = {R > : R < lj.Thus nested coset codes enable 
reconstructing Si ©5 S 2 at the decoder if A < , 1 = = .43067. 

log 2 o 

The above example illustrates the need for nesting codes in 
order to achieve nonuniform distributions. However, for the 
above example, a suitable modification of LCC is optimal. 
Instead of building codes over J^, let each user employ the 
linear code of rate 10 built on T%. The map T2 — > Xj : j = 1, 2 
defined as — > and 1 —> 2 induces a code over .F5 and it can 
be verified that LCC achieves the rate achievable using nested 
coset codes. However, the following example precludes such 
a modification of LCC. 

4 This would be the set of all binary n— length vectors 



Example 2: The source is assumed to be the same as in 
example [1] The two user MAC input and output alphabets 
are also assumed the same, i.e., X\ = X2 = J-5 and output 
alphabet y = {0,2,4}. The output Y is obtained by passing 
W = Xi ©5 X2 through an asymmetric channel whose tran- 
sition probabilities are given by PY\w(y\^-) = PY\w(y\0) = § 
for each y e y and p Y \w(0\0) = p Y \w(^) = Pr|w(4|4) = 
0.90,p F | W (2|0) = py [w (4\0) = Py\w(0\2) = Py\w(M^) = 
p Ylw (0\4)=p Ylw (0\4)=0.05. 

The technique of LCC builds a linear code over J 7 ^, It 
can be verified that the symmetric capacity for the Xi ©5 
X 2 (= W)-Y channel is 0.8965 and therefore LCC enables 
decoder reconstruct the sum if A < = 0.3861. A 

— log 2 5 

separation based scheme necessitates communicating each of 
the sources to the decoder and this can be done only if 
A < h !° S2 r = 0.3413. The achievable rate region of the test 

— 2 log 2 5 

channel in © is a{pvxy) = {R>0-R< 0.91168} and 
therefore nested coset codes enable decoder reconstruct the 
sum if A < = 0.3926. 

— log 2 5 

Example 3: Let Si and S2 be independent sources dis- 
tributed uniformly over {0,1,2}. The input alphabets Xi = 
X2 = J-3 is the ternary field and the output alphabet y = T2 is 
the binary field. Let W — l{x 1 ^x 2 \ an d output Y is obtained 
by passing W through a BSC with crossover probability 0.1. 
The decoder is interested in reconstructing W . As noted in 
fl] Example 8], W is if an only if Si ffi 3 2S 2 = 0. 
Therefore, it suffices for the decoder to reconstruct Si ©3 2S 2 . 
Following the arguments in proof of theorem Q] it can be 
proved that Si ©3 2S 2 can be reconstructed using nested coset 
codes if there exists a pmf pyjcy £ ^(WVix) sucn that 
ff(Si © 3 2S 2 ) < mm{H(V 1 ),H{V2)}-H(ViS) 3 2V2\Y). It 
can be verified that for pmf pvxy wherein Vi , V 2 are indepen- 
dently and uniformly distributed over Xi =Vi, X2 = V 2 , 
the achievable rate region is a( yx Y) = {R ■ R < 0.4790}. 
The computation rate achievable using SCC and separation 
technique are 0.194 and 0.168 respectively. The computation 
rate achievable using nested coset codes is 9' 470 " = 0.3022. 

Example 4: Let Si and S 2 be independent and uniformly 
distributed binary sources and the decoder is interested in 
reconstructing the binary sum. The MAC is binary, i.e. 
Xt = X2 = y = J-2 with transition probabilities P(Y = 
0\Xi = Xl ,X 2 - x 2 ) = 0.1 if xi ± x 2 , P{Y = 0|Xi = 
X 2 = 0) = 0.8 and P(Y = 0\X 1 = X 2 = 1) = 0.9. 
It can be easily verified that the channel is not linear, i.e., 
XiX 2 - Xi © X 2 - Y is NOT a Markov chain. This restricts 
current known techniques to either separation based coding or 
SCC fl] Section V]. SCC yields a computation rate of 0.3291. 
The achievable rate region for the test channel pyxy where 
in Vi and V2 are independent and uniformly distributed binary 
sources, X x = Vi,X 2 = V 2 is given by {R : R < 0.4648}. 
We conclude by recognizing that example |4] is indeed a family 
of examples. As long as the MAC is close to additive but 
not additive, lending LCC inapplicable, we can expect nested 
coset codes to outperform separation and SCC. [4] presents 
more such examples. 



IV. General technique for computing sum of 

SOURCES OVER A MAC 

In this section, we propose a general technique for comput- 
ing sum of sources over a MAC that subsumes separation and 
computation. The architecture of the code we propose is built 
on the principle that techniques based on structured coding 
are not in lieu of their counterparts based on unstructured 
coding. Indeed, the KM technique is outperformed by the 
Berger-Tung [6| strategy for a class of source distributions. 
A general strategy must therefore incorporate both. 

We take the approach of Ahlswede and Han [5 Section VI], 
where in a two layer source code is proposed. Each source 
encoder j generates two message indices Mj±,Mj2. Mj-y is 
an index to a Berger-Tung source code and Mj2 is an index 
to a KM source code. The source decoder therefore needs 
Mn,M2i and M\2 © M22 to reconstruct the quantizations 
and thus the sum of sources. We propose a two layer MAC 
channel code that is compatible with the above source code. 
The first layer of this code is a standard MAC channel code 
based on unstructured codes Q, E|. The messages input to 
this layer are communicated as is to the decoder. The second 
layer employs nested coset codes and is identical to the one 
proposed in theorem Q] A function of the codewords selected 
from each layer is input to the channel. The decoder decodes 
a triple - the pair of codewords selected from the first layer 
and a sum of codewords selected from the second layer - 
and thus reconstructs the required messages. The following 
characterization specifies rates of layers 1 and 2 separately 
and therefore differs slightly from [5. Theorem 10]. 

Definition 5: Let H) Ali (Ws) be collection of distributions 
Pt 1 t 1 s 2 s 2 defined over 7i x T2 x S 2 such that (a) Ti,T 2 are 
finite sets, (b) psiS 2 = w s, (c) T x — Si - S2 - T 2 is a Markov 
chain. For p T s G ®ah(Ws), let 

f (R n ,R 12 ,R2) el 3 ■ Rn > I^-S^), ) 
Ps(pts): = { R12 >I{T2;S2\T X ),R2 > H(S 1 ®S 2 \T), 

{ Ru+Ri2>I(T;S) J 

Let f3s(Ws) denote convex closure of the union ftsjprs) over 
Pts G B~{Ws) ~ 
We now characterize achievable rate region for communicating 
these indices over a MAC. We begin with a definition of 
definition of test channels and the corresponding rate region. 

Definition 6: Let D G be collection of distributions 
Pu 1 u 2 v 1 v 2 x 1 x 2 y defined on U\ x U 2 x S x S x X\ x X 2 X J 7 
such that (i) p UV x = Pu 1 v 1 x 1 Pu 2 v 2 x 2 , (ii) 
Py\xuv = Py\x = W Y \x- For p UV x Y G Be, let 
Pc(p uvx y) be defined as 

(-Rii,fli2,fl2)eR 3 :0<i?n</(;7i:Y,(72,Vi©V2), 

0<Ri2</(t/2;V',c;i,viey2),Rii+iii2<i"(c/;y,Viev r 2) 

^ R 2 <J4? m i a (V\U)-H(V 1 (BV 2 \Y,U) 

Rn + R 2 <J^ m i Il (V\U)+H(Ui)-H(V 1 ®V 2 ,U 1 \Y,U 2 ) 
Ri 2 + R 2 <.# e „ l in(V\U)+H(U 2 )-H{V 1 <3V 2 ,U 2 \Y,U 1 ) 
Rii + Ri 2 + R 2 <-^ n i a (V\U)+H(U 1 )+H(U 2 )-H(V 1 (BV 2 ,U\Y) 

where Jf milL {V\U) : = mia{i?(Vi|Z7i), H(V 2 \U 2 )} and 
define Pc(Wy\x) as the convex closure of the union 



Pc( Puvx y) over puvxy G D G (W Y \x)- 

Theorem 2: The sum of sources (S,Ws) is computable 
over MAC (X, y, W YlK ) if Ps{Wg) n Pc(W Y \x) ? <P- 

Remark 1: It is immediate that the general strategy sub- 
sumes separation and computation based techniques. Indeed, 
substituting T, LL to be degenerate yields the conditions pro- 
vided in theorem Q] Substituting V_ to be degenerate yields 
separation based technique. 

V. Concluding Remarks 

Having decoded the sum of sources, we ask whether it 
would be possible to decode an arbitrary (non-additive) func- 
tion of the sources using the above techniques? The answer 
is yes and the technique involves 'embedding'. Example [3] 
illustrates embedding and a framework is proposed in [4 |. This 
leads us to the following fundamental question. The central 
element of the technique presented above was to decode the 
sum of transmitted codewords and use that to decode sum of 
KM message indices. If the MAC is 'far from additive', is it 
possible to decode a different bivariate function of transmitted 
codewords and use that to decode the desired function of 
the sources? The answer to the first question is yes Indeed, 
the elegance of joint typical encoding and decoding enables 
us reconstruct other 'well behaved' functions of transmitted 
codewords. We recognize that if codebooks take values over 
a finite field and were closed under addition, it was natural 
and more efficient to decode the sum. On the other hand, if 
the codebooks were taking values over an algebraic object, 
for example a group, and were closed with respect to group 
multiplication, it would be natural and efficient to decode 
the product of transmitted codewords. Since, we did not 
require the MAC to be linear in order to compute the sum 
of transmitted codewords, we will not require it to multiply in 
order for us to decode the product of transmitted codewords. 
We elaborate on this in PI . 

Acknowledgment 
This work was supported by NSF grant CCF-1111061. 

References 

[1] B. Nazer and M. Gastpar, "Computation over multiple-access channels," 
IEEE Trans, on Info. Th., vol. 53, no. 10, pp. 3498 -3516, oct. 2007. 

[2] A. Padakandla and S. Pradhan, "Nested linear codes achieve marton's 
inner bound for general broadcast channels," in 2011 IEEE 1SIT Pro- 
ceedings, 31 2011-aug. 5 2011, pp. 1554 -1558. 

[3] J. Korner and K. Marton, "How to encode the modulo-two sum of binary 
sources (corresp.)," IEEE Trans. Inform. Theory, vol. 25, no. 2, pp. 219 
- 221, Mar 1979. 

[4] A. Padakandla and S. Pradhan, "Computing sum of sources 
over an arbitrary multiple access channel," available at 
http : //arxiv. org/abs/1301 .5 684. 

[5] R. Ahlswede and T. Han, "On source coding with side information via 
a multiple-access channel and related problems in multi-user information 
theory," IEEE Trans, on Info. Th., vol. 29, no. 3, pp. 396 - 412, may 
1983. 

[6] T. Berger, Multiterminal Source Coding. In: The Information Theory 

Approach to Communications (ed. G. Longo), CISM Courses and Lecture 

Notes No. 229. Springer, Wien-New York, 1977. 
[7] R. Ahlswede, "Multi-way communication channels," in Proceedings of 

2nd ISTT, Thakadsor, Armenian SSR, Sept 1971, pp. 23-52. 
[8] H. Liao, "A coding theorem for multiple access communications," in 

Proceedings of 2nd IS1T, Thakadsor, Armenian SSR, 1972. 



